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CRITERIA FDR EVALUATING EiSERiJCrieiiAfc mSDUCIS 



What criteria are used to judge the effectiveness of a learning kit? What makes brie 
textbook a better choice than another? What criteria are considered in evaluating 
non-print material? These questions are Frequently directed to people with expertise 
in professional education. To assist our colleagues in making informed decisions 
about a product's educational value and other evaluative issues, the following 
checklist is suggested. 



EVALUATION OF INSTRUCTIONAL PRODUCTS: A WORKABLE CHECKLIST 



li Product Title or Nane: 



Publisher :- 



Publishing Date: 

II. T^pe of Product: 

A. Textboo k 

B. Model 



e« Films trip- 
D. Pamphlet 



E. Graph or Chart_ 



Unit Cost: 



appropriate description) 

F. Programmed Materials 

- G. Learning Kit 

H. Instructional Modufce- 

I. Software 

J- Other (describe) 



RATING SCALE (III-XVII) 
COLUMN 1-YES OOLlttN 2-NO COLUMN 3«UNCERXAIN COLUMN 4-NOT APPLICABLE 

(Check Ap p rop riate Column) 



III. Purpose: 

A. Is the gpal of the product clearly stated? 

B. Does the product accomplish what was intended? 

IV. Objectives: 

A. Are objectives stated in performance terminology? 

B. Are objectives sequenced in proper order? 

C. Do objectives cover all aspects of the content? 

D. Are objectives attainable by the learner? 

V. Front End Analysis: 

Ai Is the product based on needs assessment? 
B. Is there evidence of instructional analysis? 



D. 



fj^f 2 f 3 f 4_f 




i I 
i ! 



*; 1 11 H 



3 



-2- 



GOLUMN 1-YES 



RATING SCMJE (III-Xmj 
COLUMN 2-NO COLUMN 3-lJNCEKIAIN COLUMN 4=NOT APPLICABLE 
(Check Appropriate Column) 



VI. Prerequisite Skills/Knowledge: 

A. Is there a prerequisite test of entry Iev£L skills? 

B. Is there a prerequisite test of entry level knowledge? 

VII. Content: 

Ai Does the content meet the stated goal and objectives? 
B. Is the content valid? 

Gi Is the subject matter content appropriately sequenced? 
D. Is the content appropriate for the intended audience? 
Em Is the content sufficient in quantity to cover stated 

objectives adequately? 
F; Is the content sufficient in quality to cover stated 

objectives adequately? 
6; Is the content factually correct? 
H. Is information repeated? 

VIII. Audience: 

A. Is the intended audience specified? 

B. Is the vocabulary appropriate? 

C. Is the reading level appropriate? 

D. Is the content easily readable? 

IX. Strategies and Materials: 

A. Does the product allow for learner feedback, during 
* presentation, covering the stated objectives? 

B. Is information repeated? 

C. Is there a post test? 

D. Are the post test items consistent with the stated 
objectives? 

E. Are alternate methods of presentation and use of the 
product suggested? 

F. Can the content presentation be group-based? 

G. Can the content presentation be self- paced? 
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H. Are opportunities for further learning suggested? 
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wuum 1-YES 



RATING SCALE (III-XVII) 
COLUMN 2»N0 OOLUMM 3-tN(Sld!AIN CXOJMN 4-NCT APPLICABLE 
(Check Appropriate Column) 



IX. Strategies and Materials: (Continued) 
I. Is the content of appropriate length? 
J. Is the speed appropriate for the learner? 

(i.e., Does the learner have time to take notes?) 
K. Can the materials be easily used by the teacher 

and/or learner? 
L. Is the media used appropriate to objectives? 
H. Are instructions for using the product clearly written 

and easy to follow? 
N. Are the materials expendable? 
0. Are the materials durable? 

P. Is the instructor's manual included with the product? 
Q. Does the manual suggest how the product material may 
be used? 

R. Does the manual indicate the necessary qualifications 
of teachers for using the product effectively? 

S. Does the manual list field data bri the product's 
effectiveness as an instructional aid? 

T. Does the manual suggest a typical setting or time 
frame for its use? 

U. Is the manual printed clearly? 

V. Is the manual type large enough? 

W. Is the manual easy to follow? 

X/ Technical Aspects: 

A; Does the filmstrip have visual clarity? 

B. Are illustrations clear and organized effectively? 

C. Are illustrations clearly explained? 

D. Are illustrations appropriate to the content? 

E. Does the audio medium of voice have clarity? 

F. Is the background music appropriate? 

6. Is speed of visual and audio portions appropri* 
timed? 
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RATING SCALE (III-XVII) 
COLUMN 2-NO COLUMN 3-UNCERTAIN COLUMN 4=NCT AP PLICAB LE 



Appropriate Column) 



XI. Evaluation: 

A. Is a criterion-referenced test included? 

B. Is there a pre- test? 

C. Is there a post- test? 

D. Can product be revised based on results of evaluation? 

E. Does the product provide for a method of measuring 
learner behavior change? 

F. Are test items correlated with stated objectives? 

G. Can evaluation results be verified? 

H. Is the learner asked to evaluate the product? 

I. Was formative evaluation used in the product ' s 
development? 

XII. Overall Design: 

A. Is the product systematic in its content presentation? 

B. Is the length appropriate? 

C. Is the instructor' s manual all-inclusive? 

D. Is there a glossary? 

E. Is there a bibliography? 

F. Is the product free of bias? 

G. Does the content contain abstractors? 



XIII. Field Test: 

A. Has the product been field tested? 
s B. Has the product been revised or updated? 



XIV. Physical Appeal: 

A. Does the product come attractively packaged? 
Bi Are the instructor's manual , filmstrip, arid cassette 
easy to use? 

Ci Is the instructor's manual easy to read and follow? 

D. Is the filmstrip easy to view and use? 

E. Is the cassette easy to listen to arid use? 
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eSLUHf? i=YES 



RATING SCALE (III-XVII) 
COLUMN 2-NO COLUMN 3»lJN<3ldMJI COLUMN 4*NOT APPLICABLE 
(Check Appropriate Cblunn) 



. XIV. Physical Appeal: (Continued) 

F. Does the use of color in the films trip add to the 
effectiveness bC the content, such as illustrations 
and diagrams? 

G. Does the product stimulate appeal to the senses and 
imagination? 

XV. Managenent: 

A. Is broad application possible? 

B. Is necessary hardware typically available? 

C. Is hardware difficult to use? 

D. Are suggestions given for management of instruction? 

XVI. Authorship: 

A. Is the author identified? 

B. Are the author's credentials specified? 

C. Was the author qualified to develop the product's 
contents? 

D. Does the author have experience in the fie]d the 
product addresses? 



XVII. Cost: 

A. Is the product cost effective as a mediun of learning? 

B. Is the product package expensive? 

V £. Are replacement components of the product's package 
expensive? 

D. Is hardware needed expensive? 

E. Is time for use of product a costly fc actor? 

F. Do teacher costs for product use go beyond contractual 
costs? 
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Narrative Comments : 



Use this space to make any comments about the product not 
covered in this checklist. 
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